Quantum Fine-Grained Entropy 
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Regarding the strange properties of quantum entropy and entanglement, e.g., the negative quan- 
tum conditional entropy, we revisited the foundations of quantum entropy, namely, von Neumann 
entropy, and raised the new method of quantum fine-grained entropy. With the applications in entan- 
glement theory, quantum information processing, and quantum thermodynamics, we demonstrated 
the capability of quantum fine-grained entropy to resolve some notable confusions and problems, 
including the measure of entanglement and quantumness, the additivity conjecture of entanglement 
of formation etc, and the definition of temperature for single quantum system. 



I. INTRODUCTION 

Entropy is one fundamental concept in physics and 
has been diversified in different studies, e.g., information 
processing and thermodynamics In these years, 

the development of the entanglement theory and quan- 
tum information processing (QIP) has stressed the signif- 
icance of quantum entropy, e.g., von Neumann entropy 
and the quantum relative entropy. However, weirdness of 
quantum characters has caused much attention as well as 
trouble in the study of quantum entropy and entangle- 
ment. Discordance exists between the classical Shannon 
entropy and the quantum entropy. Also, due to entangle- 
ment, the property of quantum entropy becomes pretty 
strange, e.g., the quantum conditional entropy can be 
negative. Various measures of entanglement could con- 
fuse the physical essence of entanglement, also the differ- 
ence between entropy and entanglement. 

The difficulties in the study of quantum entropy and 
entanglement not only simply originate from the applica- 
tions, also from some fundamental issues. One difficulty 
comes from the concept of entropy itself, e.g., there ex- 
ists confusion whether entropy is objective or subjective, 
i.e., whether entropy describes the intrinsic uncertainty 
or our uncertain knowledge of the deterministic state. 
Confusions also come from whether it should be exten- 
sive or nonextensive. Another difficulty is from quantum 
mechanics. For instance, for one unmeasured system, 
what is its state? i.e., does it has one state while it is not 
measured? Are there two kinds of uncertainty, classical 
and quantum? These difficulties result in some notable 
problems, e.g., the relation between entropy and entan- 
glement, the additivity of some quantities in QIP, the 
definitions of entropy and temperature for single quan- 
tum system etc. We will focus on these problems in our 
study, particularly, we address the concepts of "coarse- 
graining" and related "fine-graining" , which are seldom 
noticed in the study of quantum entropy and entangle- 
ment, and we introduce in the concept of "quantum fine- 
grained entropy" to resolve several related problems and 
explore some interesting features of quantum entropy. 
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There are mainly three parts of this work. In section 
HI! we introduce in the method of quantum fine-grained 
(QFG) entropy. In subsection III A[ we firstly discuss the 
physical basis for coarse-graining and fine-graining. To 
clarify the physical essence of QFG entropy, we investi- 
gate the formalism of state matrix in subsection III Bl we 
also argue that the existence of QFG entropy is indicated 
in the study of QIP and quantum foundation. We present 
the primary formalism of QFG entropy in subsection lll CI 
and show that von Neumann entropy is a kind of coarse- 
grained entropy. In section UTTl we study the fundamen- 
tal requirements for the definition of entropy, based on 
which, we analyze the main properties of Shannon en- 
tropy, von Neumann entropy and the QFG entropy, also 
highlight their difference. After the study of the founda- 
tion of QFG entropy, in section IIVI we explore some of 
the potential applications, mainly in three aspects: en- 
tanglement theory in subsection IIV Al quantum informa- 
tion processing (QIP) in subsection IIVBI and quantum 
thermodynamics in subsection llV CI At the end in section 
IVl we conclude. 



II. QUANTUM FINE-GRAINED ENTROPY 

In this section, we aim to introduce in the concept 
of quantum fine-grained entropy. The physical founda- 
tion of QFG entropy is based on the methods of coarse- 
graining and fine-graining, which relates to renormaliza- 
tion, also on the theory of density matrix. We also verify 
that the commonly used von Neumann entropy is a kind 
of coarse-grained entropy. 



A. Coarse-graining and fine-graining 

The method of coarse-graining is often involved in the 
theory of statistics and many-body dynamics @ . In the 
many-body system, there can be dynamics with different 
time and space scales simultaneously. For instance, the 
reaction between atoms involves the dynamics of elec- 
trons, as well as the dynamics of nucleus, which can 
be ignored via the Born-Oppenheimer approximation. 
The existence of various time and space scales results 
in the complexity of the dynamics. Coarse-graining is 
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the method used to reduce the complexity of the dy- 
namics also the geometric structure of the system, and 
sometimes it has to be employed since the fine-grained 
dynamics is not attainable. Generally, there are kinds of 
coarse-graining in practice, here we can roughly clarify 
two types according to the scale property of the dynam- 
ics. type-I: coarse-graining within one scale, e.g., ignoring 
and tracing out some bodies of the many-body dynamics. 
type-II: coarse-graining between scales, e.g., ignoring the 
fast process i.e. the effect of this process is time-averaged 
out. Note that our simple classification of the types of 
coarse-graining does not affect the validity of our inves- 
tigation on the QFG entropy. 

There exist some well-known coarse-graining proce- 
dures in Classical Mechanics (CM). The classical dy- 
namics can be described in the phase space, which can 
be divided into lattice with finite action of each region. 
In practice, there can be different strategies for coarse- 
graining. The basic one comes from the uncertainty prin- 
ciple ApAq > H/2 due to Quantum Mechanics (QM), 
which provides the fundamental limit of the precision of 
measurement. Also, the information we know about the 
dynamics at each point of the phase space might be only 
probably true, thus we have to make average of action of 
each region. Another strategy can be due to some of the 
degree of freedom (d.o.f) of the dynamics is totally un- 
certain, then we have to ignore the d.o.f we do not know. 
Note that, the difference between ignoring and tracing 
out is trivial for classical dynamics since measurement 
does not play the fundamental roles, which is not the 
case for QM studied below. 

In QM, the dynamics of density matrix acts in the 
Hilbert space @. One of the well-known yet not well- 
understood coarse-graining is that in many-body system, 
e.g., multi-spins, the local state of one body is deduced 
by tracing out the other parts of the global states. How- 
ever, coarse-graining does not directly mean tracing out, 
instead, there exists a step of "ignoring" beforehand. For 
instance, for Bell state |^> = ^(|00) + \U))ab, firstly 

by ignoring state of B we get \ip') = ^(|0) + \l)) A \B), 
where \B) labels state of B; then tracing out system B, 

we finally get \ipA) — ^(|0) + |1)), which is a super- 
posed state. This is obviously different with the stan- 
dard approach, where we trace out system B directly 
resulting the totally mixed state pa — diag(l/2, 1/2). 
Note that state pa is the result of the optimal measure- 
ment of state \iPa), yet, coarse-graining does not actu- 
ally involve any measurement. This is type-I coarse- 
graining. There exists another coarse-graining type in 
Hilbert space, which is type-II, that we take several non- 
orthogonal states as orthogonal basis. For instance, for 
state p = ^iPil&X&l) (<t>i\4>j) 7^ hj, apply coarse- 
graining as \4>i)— with — Sij, then state p — 
diag(pi,p2, • • • )■ This kind of coarse-graining can be un- 
derstood as a mean of labeling or encoding. This type of 
coarse-graining is involved in the definition of von Neu- 
mann entropy, as we will analyze later on. Besides, there 



can be other kinds of coarse-graining in Hilbert space 
[lij, e.g., the density matrix can be cut off into blocks 
and some blocks are replaced by identity matrix while 
maintaining the trace. 

In this work, instead of further analyzing on the 
method of coarse-graining itself, we will mainly focus 
on the interplay between quantum coarse-graining and 
quantum entropy. 



B. Why do we need quantum fine-grained entropy 
in quantum mechanics? 

To clarify the concept of quantum entropy, we need 
to start with the theory of density matrix, in the follow- 
ing, we will call p as "state matrix" following the book 
since the phrase "density" is quite misleading. For 
single system, the complete description of the system is 
the state vector written in matrix formula as state 
matrix p = \ijj}(ip\, where the coherence (non-diagonal el- 
ements) is complete. If the coherence of the state matrix 
degenerates, we call the state as "mixed state" , where p 
cannot be written as if the coherence disappears, 

we call it as "classical state" . One well-known fact is that 
the physical system corresponding to one state matrix p 
is not unique, which indicates that the physical reality of 
a system relies directly on the detailed decomposition of 
the state matrix, as the result, the quantum entropy we 
can manipulate should be different. 

It is established that the classical world results from 
decoherence and entanglement H, here we show that in 
addition to which, the classical state can directly come 
from classical mixing. To start, we present the formal- 
ism of state matrix Q in a new way. For many-body 
system, each body i lives in one Hilbert space Sji. There 
can be two basic types of the composite space, one is 
in direct-sum form fj/ = ®u the other is in direct- 
product form S)n = 0"i5i. For Sji, there must be 
no (or weak) interaction among the bodies, i.e., they 
form an ensemble, each body obeys the Liouville equa- 
tion ihpi = [Hi, pi], (A), with Hamiltonian Hi, the whole 
system obeys ihp = [Hi,p], (a), where Hi = ® i Hi, 
p = The equation (a) is equivalent with the set 

of equations (A) for each body. Now, make the sum of the 
set of equations (A), note that there might be several bod- 
ies with the same pi , thus we have the probabilities pi for 
Pi. After some algebra, we get ihp = [H'j,p], (f3), where 

p = J2T <n PiPii M'l = \ YT % ^i is trie average Hamil- 
tonian. In practice, for the ensemble of identical parti- 
cles, they have the same Hamiltonian, then H\ = Hi- 
The equations (a) and (/?) are equivalent, the two forms 
(J)™ pi and " Pi Pi °f P are also equivalent, and the 
mixed state just comes from the classical mixing since 
there is no interaction among them (lpj . For S^jj, where 
there exist interactions among the bodies, the global sys- 
tem can be decomposed as Y$>) — J2i a i\ e \ e 2 ' ' ' e «)> wrtn 
\e l j) as the basis of the j-th body, which can be a multi- 
partite entangled state. In QM, we need to pay attention 
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to the notion of "single system", since it can be single 
body, e.g., one electron, or can even be the whole uni- 
verse, which is highly a many-body system, due to entan- 
glement. For single body system, the only possible origin 
of classicality comes from the interaction with other sys- 
tem, e.g., environment E, otherwise it stays as pure state. 
The interaction with the general form H = J^. Si <S> 
where operator Si (Ei) acts on the system S (E), can en- 
tangle the S and E together. That is, the local coherence 
within S and E transfers to the global shared coherence 
(entanglement). When only measuring the system S, we 
will find that S is in mixed state. However, before any 
measurement, the system S is not necessarily in mixed 
state (also see Appendix lA]) . Note that the system can 
stay pure when this interaction is not enough to gener- 
ate entanglement, e.g., if the state of E is classical, such 
as magnetic field, the coherence will stay within the sys- 
tem. For multi-partite entangled state, by tracing out 
some parts, the state of the remains can be in mixed 
state depending on the types of entangling Q. To sum 
up briefly of the analysis above, relying on the two dif- 
ferent structures of many-body Hilbert space and state 
matrix, there are two kinds of origins of classicality: mix- 
ing and entanglement. 

One of the consequence of the above study is that, for 
instance, for state p — diag(l/4, 1/4, 1/4, 1/4), we are 
not aware of its physical origin, e.g., it could be the sin- 
gle body system entangling with an environment, or two- 
body system entangling with other bodies, or a mixture 
of the Bell states, for different physical reality, the corre- 
sponding quantum entropies should be different, and the 
method of fine-graining is necessary. 

In the study of QIP, there are also some hints for the 
existence of the QFG entropy, here we briefly discuss 
some of them as follows. Firstly, information is often 
classified into two types: classical and quantum (speak- 
able or unspeakable). We say a quantum particle car- 
ries quantum information, e.g., the spin of one electron, 
even the electron is in a pure state \ip) = a\ f) + (3\ l) , 
it means that the entropy of pure state should not be 
zero! Secondly, different pure states are different, phys- 
ically. For instance, the no-cloning theorem |l2J states 
that it is impossible to clone unknown states, e.g., two 
non-orthogonal states |i/>i) and | -02 ) - To clone one state, 
we need to know all the information of the state; thus, no- 
cloning means the information of them are different. Fur- 
ther, we know the no-cloning theorem is equivalent with 
state discrimination which means that non-orthogonal 
states cannot be perfectly distinguished, which is fur- 
ther the analogue to the classical case to distinguish two 
probability distributions {pi} and {qi}. Obviously, there 
are entropies of the two distributions, then it is reason- 
able that the entropies of the states and j^) are 
not zero, either. Thirdly, from the spectrum theory of 
matrix, the usual quantum entropy only addresses the 
eigenvalues. However, the eigenvalues and eigenvectors 
both have physical meanings, the eigenvalues cannot rep- 
resent the properties of the matrix totally, e.g., the Pauli 



matrix have the same eigenvalues Ai,2 = ±1, yet, they 
are different operations. 

Furthermore, from the perspective of quantum foun- 
dation, the basic elements in QM are algebra and vector 
space, different from CM. Statistics is inherent in quan- 
tum dynamics, which is a way to describe the statisti- 
cal properties of reality, independent of deterministic de- 
scription, e.g., CM or Relativity. That is to say, the 
completeness of quantum description of reality is in the 
quantum probabilistic sense. As a result, the wave func- 
tion, although complete in the quantum sense, contains 
inherent uncertainty thus nonzero entropy. 

From the above arguments, we can draw some lessons, 
for clarity, listed as follows. 

Lesson 1. The quantum entropy of the pure state is 
not zero. 

Lesson 2. The quantum entropies of the same p with 
different decompositions are different. Thus, the entropy 
p contains, the information we can possibly extract from 
it, and the work needed to "erase" the information de- 
pends on its decomposition. 

Lesson 3. For many-body system, coarse-graining car- 
ries out by ignoring some parts instead of directly tracing 
them out. 



C. QFG entropy & von Neumann entropy 

Next, we present the basic formalism of the QFG en- 
tropy. The state matrix of a general quantum system p 
can be written as 

n 

p = ^2pip l , (i) 

i 

we call each pi as a "sector", n is the number of sectors, 
Y) j Pi = I- The dimension of the system we study in 
this work is finite, the generalization to infinite dimen- 
sion case is direct. Without lose of generality, we do not 
specify the dimension of the system also the normaliza- 
tion relations we study below unless necessary. 

Next, we define the QFG entropy for pure state and 
mixed state. 

For pure state p — the system can be single- 

body or many-body. 

For single-body system, under the orthonormal basis 
{\k)}, define \ip) = J2 k a k\k)- The Q FG entropy is 

S FG (W) = -£K| 21 °SM 2 = H(\a k \ 2 ), (2) 

fc 

where H(-) is Shannon entropy. The QFG entropy for 
pure single-body system, highly depending on the decom- 
position, is generally nonzero, which is different from the 
common result. Also, the QFG entropy does not quan- 
tify the effects of the relative phase difference among the 
basis, since the phase relates to coherence directly rather 
than entropy, thus the QFG entropy manifests the differ- 
ence between coherence (also entanglement) and entropy. 
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Note that there also exists the non-orthogonal de- 
composition of _pure state as |^>) = ^2iJi\4>i), with 
(</>;|<M ^ &VI Q- Th e QFG entropy is S FG {\i>)) = 
- E; \H ? log \li\ 2 +Ei h\ 2 S FG (\^)). By type-II coarse- 
graining, set {| </>;)} as orthonormal basis, the QFG en- 
tropy reduces to that in Eq. @. 

For two-body entangled system |$) = Y^ r a r IV'aV'b)) 
the states {|V>^)} ({IV'b)}) form the basis of A ( B )- % 
type-I coarse-graining, we get \ip A ) = J2 r a r#A)i \^b) = 
J2 r QtWb)- The QFG entropy of the entangled system is 

S FG (\*)) = H(\a r \ 2 ) = -^|a r | 2 log| ar | 2 , (3) 

r 

and Sfg(\iI> a )) = SfgMb)) = S FG (\il>)). Then the 
mutual information between the two parts is 

Wl*» = SfgWa)) + S fg (\iI>b)) - S FG (\il>)) 

= H(\a r \ 2 ), (4) 

which is totally quantum, thus we call it as quantum cor- 
relation. As a result, there is no classical correlation in 
the pure entangled two-body system. 

For instance, for the bipartite entangled state \tp) — 
|(|00) + 1 10) + |01) - |11)), which can also be written as 
| V ,) = ^(| +) + |1-)) = f (| + 0> + 1 - 1)), with |±) = 

^(|0) ± |1», the QFG entropy of is 1 bits, of each 
party is also 1 bits, thus the QFG mutual information is 
1 bits. 

For mixed state (n > 2 in Eq. (JTJ), the QFG entropy 
is generally defined as 



Sfg{p) = H(p t 



PiS FG (pi 



and the mutual information is defined as 

Ifg{p) = H{p,) +^2p 1 Ifg{Pi), 



(5) 



(6) 



where pi can be mixed or pure. We can treat the part 
H(pi) in mutual information as "classical", and the re- 
maining part can both contain classical and quantum 
correlations depending on the formulas of the sectors pi. 
Note that the definition of QFG entropy does not de- 
pend on the supp(pi), since the sectors are unconditional 
of each other. 

For two-body system, the sector pi can be product 
state pf®pf, or entangled state, or noise etc. For in- 
stance, for the separable state 



E 



PiPi 



(7) 



by type-I coarse-graining, p A = J2iPiPt, Pb = Y^iPiPi \ 
then the QFG entropies are 

Sfg(p) = H{pi) + ^2piS FG (pf) + ^p l S FG {pf), 

i i 

Sfg(pa) = H{pi) + ^2piS FG (pf), 

i 

S FG ( PB ) = H(pi) +J2PiS FG (pf), (8) 



and the mutual information is 
I FG {p) = H{pi) = S FG (p A ) + S FG (p B ) - S FG (p), (9) 

which shows that the mutual information (correlation) in 
separable state is totally classical. 

It is clear that the formalism of QFG entropy is distinct 
with von Neumann entropy. Note that the basic formulas 
of relative entropy and conditional entropy remains since 
their definitions do not involve coarse-graining. 

In addition, there is one particular case that when 
there exist degenerate eigenvalues of the state ma- 
trix, e.g., for single-body completely mixed state p = 
diag(l/2, 1/2). Obviously, under the basis (0| = (1,0), 

1 




(1 



= (0, 1), it can be decomposed as p 




2(01) w ith Sfg = Ij an d also p 



1 / 1/2 1/2 

2 1 1/2 1/2 



with S FG = 2, or other forms. In 



1/2 -1/2 
-1/2 12 

practice, if the completely mixed state exists without be- 
ing known how it is prepared, the type-II coarse-graining 
is necessary by ignoring the entropy contained in the ba- 
sis which reduces the QFG entropy to von Neumann en- 
tropy. This follows from a more general observation that 
von Neumann entropy is practical in the case that the de- 
composition of the state matrix p is unknown, yet, which 
can cause some un-physical consequences, such as the 
negative conditional entropy. 

For multi-partite system, the definition of QFG en- 
tropy of the whole system is similar with the above, 
also the QFG entropy for each part follows by type-I 
coarse-graining, then we can define the mutual informa- 
tion between two parties or among many parties. Par- 
ticularly, we employ the notation "(n,m)-mutual infor- 
mation" for a N-partite state, with 2 < m < n < N, 
(n,m) means (n-party, m-partition), i.e., the mutual in- 
formation /( n ' m ) is defined for n parties and shared in a 
m-partition way. For instance, j( 3 ' 2 ) for state pabc can 
be I(AB : C), I {AC : B) or I(BC : A), I<- 3 ^ is just 
I (A : B : C). Below, let us do some sample calculations. 
For the Greenberger-Horne-Zeilinger (GHZ) state [l3[ 



V2 



PMBC 



(|000) + 



(10) 



the QFG entropies are S FG (ABC) = 1, S FG {AB) = 
Sfc(AC) = S FG (BC) = S FG (A) = S FG (B) = 
S FG (C) = 1, then the (2,2)-mutual information I(A : 
B) =I(B : C) =I(A : C) = 1, the (3,2)-mutual infor- 
mation I(AB : C) =I{BC : A) =I{AC : B) = 1, the 
(3,3)-mutual information I (A : B : C) = 1. For a gen- 
eral form \S) — ai|000) + ct^llll), we can find all the 
entropies are equal to the binary entropy /i(|ai| 2 ). This 
unique feature shows that the GHZ state is maximally 
entangled. The other class of three-qubit entangled state 
is the W state H [El 



\W) 



V3 



ABC 



(|001) + |010) + |100)). (11) 
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We find that all the entropies are equal to log 3, bigger 
than the GHZ state. The well-known result for W state 
is that there is no global entanglement shared by the 
three parties, yet, here we find that the (3,3)-mutual in- 
formation is also maximal, the W state is also maximally 
entangled. A four-partite cluster state [l6| is defined as 

\C)abcd = |(|0000) + |0011) + |1100) - |1111)). (12) 

For partition AB\CD, \C) A b\cd = ^(\00)ab\^ + )cd+ 
\11)ab\<I>-)cd), then state \C) AB = ^(|00) + |11)) 
with basis 1 00) and |11), state \C) C d = ^{\4> + ) + 
\4>~)) with Bell basis l^). The QFG entropies are 
Sfg{\C) ab\cd) = 1, Sfg(\C)ab) = 1, Sfg{\C)cd) — 

1, then the mutual information Ifg(\C) ab\cd) = 1- The 
cluster state can also be expressed in partition AC\BD 
(or same with AD\BC), \C) AC \bd = ^{\00)ac\00)bd + 
|01)ac|01)bz3 + |10>ac|10)bd - \11)ac\11)bd), AC and 
BD each forms a four-level system. Then, the QFG 
entropies are Sfg(\C)ac\bd) = 2 , S F g{\C)ac) = 

2, Sfg(\C)bd) = 2, and the mutual information 
Ifg{\C) ac\bd) — 2, different with the above case. We 
can see that for multi-partite state, the QFG entropies 
highly depend on the type of partition, which relates to 
practical situation directly. 

For the mutual information (correlation), we have de- 
rived some unique results. Firstly, there is no any corre- 
lation in single-body state. Secondly, correlation has two 
types: classical correlation due to mixing, and quantum 
correlation due to entanglement. Thirdly, pure entangled 
state only contains quantum correlation. Forth, correla- 
tion and the QFG entropy in multi-partite state depend 
on the type of partition directly. Fifth, the separable 
state only contains classical correlation, contrary with 
the result based on quantum discord [13, EH > as we will 
see later on. 

Furthermore, it is crucial to verify that von Neumann 
entropy is exactly a kind of quantum coarse-grained en- 
tropy. In the original gedanken experiment [19j, an en- 
semble of quantum gas which contains two kinds of par- 
ticles are stored in a box, immersed in a resevoir keeping 
constant temperature. The process for the dynamics of 
the quantum entropy is mainly as follows: 

step 1. Prepare the quantum gas in state p = (1 — 
X)pi + A2P2, with pi = \ipi){ipi\ (i=l,2) as the two states 
of the gas, A specifies the weight (probability) of the two 
states. 

step 2. Connect with another box with the same vol- 
ume, use ideal walls to separate the two states into the 
two boxes, respectively. 

step 3. Get rid of the walls, then compress the two 
boxes, with the volumes proportional to their weight, to 
get the original volume of one box. The state is then the 
same with the initial state. 

Based on the above procedure, if the two states pi and 



P2 are distinguishable, the quantum entropy satisfies 
S(p) = (l-A)5( Pl )+A5(p 2 )-Alog(A)-(l-A) log(l-A), 

note the Boltzmann's constant is ignored. The above re- 
lation depends on the decomposition of the state matrix, 
to avoid this, the entropy of the pure state and l^) 
are set to be the constant zero, then the standard form 
of von Neumann entropy is derived. 

The physical reason that why the entropy should not 
depend on the decomposition is not clear, though. Ac- 
tually, in the above argument the technique of coarse- 
graining is involved. According to type-II coarse- 
graining, here set \ipi) = |0), ^2) = 1 0(1)) are or- 
thonormal basis, then the state matrix is simply p = 
diag(l — A, A), the resulting entropy is just von Neumann 
entropy. Furthermore, no matter the supp(pi) are orthog- 
onal or not, i.e., whether they can be totally distinguished 
or not, the QFG entropy relies on the fact that different 
sectors are prepared unconditionally thus the entropies 
of sectors can add up together with the mixing entropy. 

The technique of coarse-graining and fine-graining, 
from another view, indicates that the description of en- 
tropy, to some extent, depends on our choice. In CM, we 
also need some choices, e.g., we need to choose the rela- 
tive zero point for potential. We have to say our choice 
(observation, measurement) is also physical, which is con- 
sistent with the quantum measurement theory. In clas- 
sical system, we do not need to quantify the quantum 
entropy although the uncertainty of quantum state ex- 
ists, i.e., the quantum uncertainty is treated as "hidden 
information" . However, for quantum system, the entropy 
of quantum state cannot be coarse-grained basically, i.e., 
the QFG entropy depends on the decomposition directly. 

III. BASIC PROPERTIES OF ENTROPY 

In this section, we analyze the basic properties of three 
kinds of entropies: Shannon entropy, von Neumann en- 
tropy and the QFG entropy. Note that there exist other 
kinds of entropy, e.g., Renyi entropy, which we do not 
study here. In the following, we first lay out the primary 
properties of entropy, then we compare those properties 
of the three kinds of entropies in details. 

We remind that the origin of entropy lies in ther- 
modynamics, where entropy is defined according to the 
change of heat under a certain temperature. By statis- 
tical physics, the macroscopic state is connected to the 
microscopic state, which leads to the Boltzman entropy. 
Generally, entropy describes the degree of uncertainty 
of a random variable, classical or quantum, in sample 
space. We need to pay attention to the notion of "ran- 
dom" , which means the underlying dynamics is highly 
unpredictable. Actually, there does exist the dynamics 
of the random variable, no matter how complicated it is. 
The crux is that we ignore the detailed dynamics, which 
leads to the statistical description where entropy plays 
the roles as an "order parameter" . 
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To define entropy, for simplicity, we take into account 
the two most primary requirements 0, 0, [20| , which are 
(1): the entropy is non-negative; (2): the entropy is addi- 
tive for independent random variable. Suppose a random 
variable is W = {Wi,rrii}, Wi are the elements, which are 
not random variable, rm are the corresponding probabil- 
ities, m i = 1- The entropy £ is defined as 

£(W) = -J2 m ^ogm l . (14) 

i 

It's direct to verify that the definition satisfies the two 
requirements. 

The random variable can be generalized to the case 
when the elements Wi again are random variable Wj = 
{W^,,m l a } with J2a m a = 1- Then, the definition of 
entropy is generalized to 

= -^m.logTO. + ^m^V^), (15) 

i i 

and EiyVi) = — 2 Q TO al°g m a- To prove the addi- 
tivity of the generalized entropy, let us start with the 
case of two independent random variables. Suppose 
W = {W" <g> W b ,mfm b }, <g> denotes "independence" 
or "unconditionality" , the independent random variables 
W a = {W? ,m?}, and W b = {W%,m)}, then the entropy 
is 

£{W) = -^m?m)\og{m a i m))+^m^m b j £{W?®W b ) 
i-.j i,j 

= - y^m° log m? - y^rrij log 

* j 

+ ^m,^(W i a ) + ^m^^) 

i 3 

= £(W a )+£(W b ), (16) 

which proves the property of additivity. The case of many 
independent random variables follows directly. Thus, the 
property of additivity is proved. 

From additivity, the property of subadditivity is in- 
duced when the random variables are not independent, 
i.e., there exists correlation among them. For the case 
of two dependent random variables X and y, the cor- 
relation T{ X : y) , which is called mutual information, is 
defined as 

i(x :y) = £(x) + £(y)-£(xy). (17) 

The primary property of the correlation is that it is non- 
negative i(x -.y)>o. 

The subadditivity property follows the non-negativity 
of correlation, which is 

£(Xy)<£(X)+£(y). (18) 

Here, for the quantity £(Xy), the detailed form of the 
global state is necessary. For instance, when we deal with 
classical variable, often we need to know the sequence of 



the signals, like 0,1,1,0,..., not just the probability dis- 
tribution. For quantum state, given two states pa and pb 
without the global state, we cannot calculate the mutual 
information between them. Instead, we can use other 
quantities to capture the relation between them, such as 
quantum relative entropy, geometric distance, etc. This 
manifests that the definition of mutual information de- 
pends on both the local and the global states. 

Further, from subadditivity, the property of concav- 
ity follows [l|. Suppose two random variables W a — 
{Wi,nii}, W b = {i,nii}, which together forms W = 
{Wi<g>i, mi}. The number i can be viewed as the "count- 
ing" parameter. Then, the entropy 

£(W) = ~ ^ raj log rrij + m,£ (Wj ® i) 

i i 

= - / J rrij logm,- + mj£(Wi) 

i i 

< -^ra,logm, + £ ^Y^miWA , (19) 

where we have used the properties of additivity and sub- 
additivity, which proves the property of concavity 

£ mi£(Wi) ^ £ (1lL m > W ^J ■ ( 2 °) 

By comparison of Eqs. (fH))) and (|2"D|) , we can see 
the difference between ^ Ji mi£(Wi) and £(J2 i m i Wi) is 
— mi log m,-, which is sometimes called the "mixing 
entropy" . That is, the property of cancavity can also 
be deduced directly from the definition of entropy since 
the mixing entropy is non-negative. The formula of en- 
tropy in Eq. (|14[) describes the process of mixing, and 
the formula of entropy in Eq. ([T5|) describes the process 
of re-mixing since its elements are themselves random 
variables. 

Relating to mutual information, the conditional en- 
tropy is defined as 

£{X\y) =£{X) -2{X : y). (21) 

Obviously, £{X\y) <£{X). 

There are lots of other properties of entropy especially 
for multi-random variables case, we do not analyze them 
in details here. 

Next, we turn to the properties of the three entropies, 
the random variables are: (1) for Shannon entropy: clas- 
sical random variable X = {xi,pi}; (2) for quantum 
entropy (including von Neumann entropy and QFG en- 
tropy): wave function \tp) — {|i),o:,}, and state matrix 
P = {PiiPi}: the properties are studied in details below. 

A. Shannon entropy 

Shannon entropy plays the central roles in classical in- 
formation theory, also in quantum information theory. 
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As it is well-known, here we simply present the most 
common properties without proof. 

The Shannon entropy H(X) of single classical random 
variable X — {xi,pi\, J2iPi = 1, is defined as 

H(X) = -J^PilogPi, (22) 

i 

which follows directly from Eq. (|14l) . It satisfies the prop- 
erties of non-negativity, additivity, subadditivity, and 
concavity studied above. 

The classical mutual information (correlation) between 
two random variable X and Y is defined as I(X : V) = 
H(X) + H{Y) - H(X, Y), which follows from Eq. (fl?). 
Here, we do not analyze the properties in details. 

B. von Neumann entropy 

For quantum entropy, along with the process of mixing, 
there are another two kinds of operations which can af- 
fect entropy: entanglement and measurement. Note that 
there are some connections and overlaps between the ef- 
fects of entanglement and measurement. In this section, 
we analyze the properties of von Neumann entropy and 
related entropies, e.g., quantum relative entropy. 

The von Neumann entropy of the state matrix p is 
defined as 

S{p)=-tx{p\ogp). (23) 

Note that all the properties and the proof of von Neu- 
mann entropy can be found in literature, e.g., in Ref. Q. 

Basic properties: 

Property 1 The von Neumann entropy is non-negative, 
with zero for pure state. 

The state matrix of pure state can be diagonalized with 
one diagonal element as "1" and others "0" . The physical 
reason is that the wave function is said to provide the 
complete description of a system. 

Property 2 The von Neumann entropy is maximal for 
completely mixed state. 

By diagonalization, von Neumann entropy reduces to 
Shannon entropy H(Xi) — — J2i log Aj, with Xi as the 
eigenvalues, A^ = 1. The maximum is reached when 
all the probabilities Xi equal, i.e., the state is completely 
mixed. 

Property 3 For p = ^iPiPi, its von Neumann entropy 
S(p) = H(pi) +J2iP>.S(Pi) if su PP(Pi) are orthogonal. 

The proof can be found in Ref. Q . Note that this is 
the result of the definition of entropy in Eq. (|15[). By 
comparison with the definition of QFG entropy in Eq. 
([5]), we can see that the condition that the supp(/?i) are 
orthogonal is not necessary for the QFG entropy, since 



physically the additivity of entropy only requires inde- 
pendence without referring to orthogonality. 

The "joint entropy theorem" follows from this prop- 
erty, which states that von Neumann entropy for 
classical-quantum (CQ) state p = YliPi\^)(^\ ® fj is 
S(p) — H(pi) + J2iPiS( a i)> where {\i)} are orthonor- 
mal basis for A, {ai} are the sectors for B. 
Property of mixing: 

Property 4 Concavity and mixing: 

^ S (l>Pi J < ff(Pi)+X>S0>0- (24) 

i \ i / i 

The left part follows from the property of concavity in 
Eq. "=" holds when one of Pi is "1". For the right 

part, the proof can be found in Ref. [H; while the right 
part of the inequality does not always hold [l[ . 
Properties of entanglement: 

Property 5 Subadditivity: For bipartite state pab , state 
of A is pa, and state of B is pb, then von Neumann 
entropy satisfies 

S(pab)<S(pa) + S(pb). (25) 

The "=" holds when pab = Pa®Pb, i-e., the additivity 
property. The physical reason for subadditivity is due to 
entanglement or correlation. 

Property 6 Strong subadditivity: For tripartite state 
Pabc, von Neumann entropy satisfies 

S(pabc) < S{p AB ) + S(pbc) ~ S( PB ). (26) 

The proof for this property is quite complicated pll2l1|. 
On the contrary, we will see below the strong subaddi- 
tivity for the QFG entropy is quite direct to prove. 

The quantum mutual information is defined as 
I(pab) = S(p A ) + S(p B ) - S(pab)- With subadditiv- 
ity, I (pab) > 0. The quantum conditional entropy is 
defined as S(pa\pb) = S(p A ) ~ I{pab)- 

Property 7 Negative conditional entropy: the pure state 
ab for system A and B is entangled iff S(pa\pb) < 0. 

For pure entangled state \iP)ab, the conditional en- 
tropy S(pa\pb) = —S(pb) is negative since S(pab) = 0. 

Property 8 Subadditivity of conditional entropy: 

S(pab\pcd) < S(p A \pc) + S(pb\pd), 
S(pab\pc) < S(p A \pc) + S(p B \pc), 
S( P a\pcd) < S(pa\pc) + S{ P a\pd)- (27) 

Property 9 Strong subadditivity of conditional entropy: 

S{pabc\pd) + S(pb\pd) < S{pab\pd) + S(pbc\pd)- 

(28) 
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While this property is not always true for Shannon en- 
tropy. The subadditivity and strong subadditivity of con- 
ditional entropy follows from the strong subadditivity of 
von Neumann entropy [|J from Property 6. 
Properties of measurement: 

Property 10 Orthogonal projective measurement in- 
creases entropy: suppose the state p under orthogonal 
projectors {Pi} becomes p' , then 

S(p') > S(p), (29) 

with equality iff p = p 1 . 

However, for non-orthogonal projective measurement 
and positive operator- valued measurement (POVM), the 
entropy of the system can either increase or decrease de- 
pending on the forms of the measurement. The basic 
observation is that measurement can be viewed as the 
coupling of the system, which is open, with one appa- 
ratus (environment). The change of the entropy of one 
open system does not exhibit one fixed tendency, which 
is consistent with the second law of thermodynamics. 

We mention that another quantum entropy is the quan- 
tum relative entropy defined as 5(/o||<r) = tr(plog £). 

Property 11 Monotonicity of quantum relative entropy: 
S(pa\Wa) < S(pab\Wab)- (30) 

Due to the non-negativity and monotonicity of relative 
entropy above [4| , it provides an effective way to describe 
the properties, yet not necessarily entanglement, of quan- 
tum state. 



C. Quantum fine-grained entropy 

By comparison with Shannon entropy and von Neu- 
mann entropy, in this section we present the properties of 
the QFG entropy, some of them are different from those 
of von Neumann entropy. 
Basic properties: 

Property* 1 The QFG entropy is non-negative, with 
zero for the basis of a wave function. 

As we have discussed, the QFG entropy of pure state is 
not zero. The pure state lives in the Hilbert space, which 
can be decomposed into the superposition of a set of or- 
thonormal basis {\i)}- By comparison with the classical 
statistical theory, where a random variable X defined as 
X = {xi,pi} with different values x% and probability pi, 
the basis |i) corresponds to the values Xi, which does not 
contain any entropy. The QFG entropy is defined above 
in Eq. ([2|) , which is one of the main differences from von 
Neumann entropy. 

Property* 2 The QFG entropy of pure state is maximal 
for balanced superposed state. 



By "balanced superposed state" , we mean a pure state 
\tp) = w hh the modular of the coefficients |aj| 

equal. For the QFG entropy of mixed state, there is 
no statement for the maximum since it depends on the 
entropy of the pure states being mixed. Yet, for the clas- 
sical part of QFG entropy, H{pi), it takes the maximum 
when the mixed state is maximally mixed, i.e., all pi are 
equal. 

Property* 3 Additivity: The QFG entropy of many- 
body product state p — p\ ® pi ® ■ ■ ■ is the sum of the 
QFG entropy of each part. 

We first prove the additivity for bipartite state p = 
pi <g> p 2 . If pi = \ipi)(ipi\, P2 = | ^2) (^2 1, and = 
Td=i a i\ e i), 1^2) = T,™=i/3j\fj), then the QFG entropy 
of state p is 

n m 

Sfg(p) = ^^HftfiogtM 2 ^-! 2 ) 

i=l 3 = 1 
n m 

= £M 2 logk| 2 + £|/?/log|/3,f 

i=l j=l 

= S FG {pi) + S FG {p 2 ). (31) 

If Pi = T,iPiPi = HiPMil^i P2 = Hjlj^i = 

E,-5jl<M<0jl> thcn 

Sfg(p) = S FG (^2piqjPi® o-j) 

= H (piqj ) + 2J Pi Qj Sfg (Pi ® 0-3 ) 

= H(pi) + H{q ) + ^2 l p i S FG {p i ) + ^2 Qj S FG(o-j) 

i 3 

= S FG { Pl ) + S FG {p 2 ). (32) 

If sectors pi, o~j are further mixed state, it is direct to 
verify that the additivity still holds. Also, the proof can 
be extended to the many-body case. Note the method 
for proof follows from that in Eqs. (p~6|) . 
Property of mixing: 

Property* 4 Concavity: 

^2piS FG (pi) < S FG (^PiPi^j ■ (33) 

This inequality follows directly from the definition of 
the QFG entropy, Eq. ©. 
Properties of entanglement: 

Property* 5 Subadditivity: For bipartite state pab, 
state of A is pa, state of B is ps, the QFG entropy 
satisfies 

Sfg(pab) < S FG {p A ) + S FG (p B )- (34) 
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This property is the same with that of von Neumann 
entropy, the physical reason is that the mutual informa- 
tion is non-negative. 

Relating to Property 7 of von Neumann entropy, how- 
ever, the QFG conditional entropy is non-negative. For 
bipartite pure entangled state \i[))ab, we can see that 
Sfg(pab) = S fg (pa) = S FG {p B ), then S(p A \p B ) = 0. 
This result is reasonable, since zero conditional entropy 
shows that if one party is measured, our uncertainty of 
the other party is zero, i.e., the two parties are perfectly 
correlated. We will investigate the problems of entangle- 
ment in the next section in details. 

Property* 6 Strong subadditivity: For tripartite state 
PabC) the QFG entropy satisfies 

Sfg(pabc) < Sfg(pab) + S F g{pbc) - S F g(pb)- (35) 

From the definition of QFG (3,2)-mutual information 

Ifg{pab '■ Pc) = Sfg(pab) + Sfg(pc)— Sfg(pabc), 
then the strong subadditivity reduces to Ifg(pb '■ Pc) < 
Ifg{pab '■ pc)t which is obvious for the QFG entropy. 
This is equivalent to the property that conditioning re- 
duces entropy. Note that this proof does not hold for von 
Neumann entropy, since in which case, the conditional 
entropy can be negative. 

The QFG conditional entropy for bipartite state is de- 
fined as Sfg(pa\pb) = Sfg{pa) - Ifg(pa ■ Pb)- The 
properties of subadditivity of QFG conditional entropy 
are the same as von Neumann entropy, which can be 
proved by transferring to inequalities of QFG mutual in- 
formation. However, the strong subadditivity does not 
always hold for QFG conditional entropy, neither for 
Shannon entropy, since four-partite QFG mutual infor- 
mation which depends on partition is involved. 

Properties of measurement: Contrary with the prop- 
erty of von Neumann entropy, we find that the orthogonal 
projective measurement does not necessarily increases 
entropy Following the same proof the inequality 
tr(plogp) — tr(plogp') > holds due to the property 
of relative entropy. The QFG entropy of the initial state 
p is Sfg(p) = — tr(/?logp) + So, of the finial state p' is 
Sfg(p') = — tr(/°' log//) + Si, with constants So and S\ 
depending on the formula of states p and p' , respectively. 
Then, we can find Sfg(p') ~ Sfg(p) > S\ — Sq. Since 
Si — Sq can be negative, we conclude that the orthogo- 
nal projective measurement does not necessarily increase 
entropy. 

Furthermore, the QFG entropy under arbitrary mea- 
surement can either increase, decrease, or remains. For 
instance, during the teleportation process, the informa- 
tion is transmitted between Alice and Bob, and the total 
amount of information is conserved. Suppose Alice holds 
the arbitrary state \ip) = ai|0) +a2|l), the QFG entropy 
is the binary entropy /i(|ai| 2 ). Bob holds one of the Bell 
states, the total QFG entropy of the two parties is 2 bits. 
After Bell measurement of Alice, she will detect four dif- 
ferent results, thus, 2 bits of information. The states of 
the rest party will also be of four different forms, yet 



all have the same entropy /i(|ai| 2 ). As the result, the 
total QFG entropy, which is ft.(|ai| 2 ) -I- 2 bits, remains 
unchanged. 

We briefly conclude that the three kinds of entropy 
all satisfy the primary properties of entropy, i.e., non- 
negativity, additivity, subadditivity, and concavity. The 
difference is how they satisfy the properties, and the proof 
for the properties of QFG entropy follows from rather 
simple mathematical constructions. 



IV. APPLICATIONS OF QUANTUM 
FINE-GRAINED ENTROPY 

In this section, we will investigate the possible appli- 
cations of the method of QFG entropy. For instance, if 
we assume the whole universe as a pure state, its entropy 
will be zero, which is apparently conflict with the obser- 
vation based on thermodynamics. With the method of 
QFG entropy, the confliction can be resolved. Also, in the 
schemes of quantum key distribution, namely, the BB84 
scheme (22[, the bit value (I) is encoded in nonorthog- 
onal polarization states \H) and \L) (\V) and \R)) [23f . 
When the basis defined by \H) and \V) (\L) and \R)) 
is chosen for measurement, the states \L) and \R) (\H) 
and \V}) will show the property of QFG entropy, which 
is used to detect the eavesdropping. The common argu- 
ment that measurement will disturb the state is consis- 
tent with QFG entropy. One can check that the security 
of the quantum key distribution is ensured by QFG en- 
tropy, and the proof of security remains the same. In 
the following, we will analyze in details the applications 
of the method of QFG entropy in entanglement theory, 
quantum information processing, and quantum thermo- 
dynamics. 



A. Entanglement theory 

Entanglement, as well as nonlocality, is viewed as the 
central character of quantum phenomenon. Many work 
have been devoted to quantify the degree of entangle- 
ment of entangled state. From the view of quantum co- 
herence, the reason for entanglement also nonlocality is 
that there exists shared (or distributed) coherence which is 
supported nonlocally by not only one body of the whole 
system [24j . Different methods and quantities can be 
employed based on different physical arguments, e.g., we 
can quantify the amount of shared coherence (like concur- 
rence [25j, negativity [26|, degree of entanglement [2JJ), 
the degree of quantum correlation (like entropy of entan- 
glement [2p,j29| , quantum relative entropy [3(| , quantum 
discord 1171. 11811 ) . or the degree of nonlocality (like Bell's 
inequality [31]). In this section, we show that, due to 
the coarse-graining of quantum entropy, some results are 
inappropriately used in literature. We also need to be 
careful of the notions of "entanglement" and "quantum 
correlation" , since they are kind of mixed up in literature 
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in order to quantify the quantum propertiexs of entan- 
gled state. 

Before our analysis of different measures of entangle- 
ment, we define three terminologies which are necessary 
in case of any confusion. If one quantity can be derived 
from another quantity, we say these quantities are equiv- 
alent. If several quantities give similar descriptions of the 
physical reality without confliction, we say these quanti- 
ties are compatible. The whole set of compatible quanti- 
ties are said to be consistent with the physical reality. For 
instance, the well-known "fidelity" and "trace distance" 
are compatible yet not equivalent, since one cannot al- 
ways be derived from the other. 

For clarity, we also classify two kinds of "paradigm" 
of the methods to quantify entanglement. One is the 
"entropy+separablility" (E-S) paradigm, which quanti- 
fies entanglement from the entropic (informational) view, 
and the entangled state is defined relative to separable 
state. Within this paradigam, for instance, there are 
the entanglement of formation and distillation, quan- 
tum relative entropy, concurrence, negativity, etc. The 
other paradigm is based on quantum discord, the "dis- 
cord+classicality" (D-C) paradigm, which quantifies the 
entanglement from the measurement view, and quantum- 
ness instead of quantum correlation is defined relative to 
classicality of classical state. 

The entropy of entanglement of the entangled bipartite 
state |*) = J2i ailip^iph) is defined as = S(p A ) = 

S(p B ) = -trO A logpA)- 

For example, the entropy of entanglement of Bell 
states, which are defined as 



1^) 



V2 
2 
V2 



|^±> = -V(|01)±|10», 



(36) 



(|00) ± |11)), 



are all the same, e.g., E(\ifi + )) = S(pa) — 1, with pa — 
diag(l/2, 1/2). The von Neumann entropy of pure state 
is 0, thus, the conditional entropy S(pa\pb) = —1, 
which is not quite intuitive. We know that the Bell state 
contains one "ebit" (bit of entanglement) plus one bit of 
classical entropy [32|. However, according to the method 
of QFG entropy, S FG (\^+}) = S FG (p A ) = S FG {p B ) = 
IfgQ^)) — 1> an d Sfg(pa\pb) — 0. The zero condi- 
tional entropy means that there is no uncertainty of the 
unmeasured party conditioned on the measured party, 
which just shows the two systems are perfectly correlated. 
The Bell state contains one bit of quantum correlation 
without any classical correlation. One the contrary, the 
negative conditional entropy is unreasonable. Although 
in this case the entropy of entanglement gives the same 
result with the QFG mutual information, for mixed en- 
tangled state, they will provide different results. 

The entanglement of formation (EoF) for bipartite 
state pab is defined relying on the entropy of entan- 
glement as E f (pab) = hrf ^iPi^d^i)) f° r au kinds 
of decomposition into pure state pab = X^KlV'iXV'il- 



The EoF quantifies the least amount of entropy of en- 
tanglement to form the entangled state pab- Accord- 
ing to the QFG entropy, the EoF can be modified to 
E F g(pab) = miJ^tPJFGd^i})- 



As an example, we study the Werner state [33[ of two 
parties A and B, which is non-separable and can be ex- 
pressed as 



p w = (l-z) 1 + zH + )(4> + \. 



(1 



(37) 
zpo, with 



By coarse-graining, pa 

po = | f J j ^ . The QFG entropy of the three states 
are 



S FG ( Pw ) = H(z) + (1-z)S fg (-) + zS fg (\tJj+}) 
= H(z) + 2-z, 

S fg (pa) = H{z) + (1 - z)S FG {~) + zS FG (p ) 



= H(z) + 1 = S FG {p B ), 



(38) 



as the result, the mutual information I FG (p w ) = H(z) + 
(1 - z)I FG {\) + zI FG {\^+)) = S FG {p w ) - 2S FG ( PA ) = 
H(z) + z. In the calculation, S FG {\ ) = S(j) = 2, 
S FG (±) = 5(|) = 1, I FG {\) = /(§) = 0, since we 
have to do coarse-graining for the noise | and |, and 
I FG (\ip + )) = 1. In the mutual information I FG {p w ), the 
classical part is H(z), which describes the mixing of Bell 
state with noise, the quantum part is z, which comes from 
the quantum correlation within the Bell state. Also, we 
can find E FG {p w ) = z. 

Interestingly, the Werner state can be written in other 
forms, since we can decompose the noisy term. If it is 
written as 



1 + 3z 



4 

1 - z 



i 



the QFG entropy becomes 



S FG {p' w 



1 



1 



3z, 1 
; — log — 



4 

1 - z 



3z 



\<t>-){r\, 



(39) 



3z , 1 
log- 



4 ° 4 

(40) 

which is different with S FG {p w ). And we find that 
S FG (p' w ) = I FG (p' w ) = S FG (p' A ) = S FG {p' B ). This 
shows that since the Bell states are maximally entangled 
state, the mixture of Bell states p' w is also maximally 
entangled, although there exists extra classical mixing 
entropy. 

However, according to the entropy of entanglement, 
the Werner state, no matter what kind of decomposition, 
is separable when z < 1/3. This means that the QFG en- 
tropy is not compatible with the entropy of entanglement 
also the entanglement of formation. On the other hand, 
the quantum discord of Werner state is non- negative, and 
increases with z from to 1, which seems to be compat- 
ible with our result above. The quantum discord is said 
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to capture the quantum correlation properly, yet, we will 
demonstrate below the notion of quantum discord needs 
to be reconsidered. 

The quantum discord D(p^) of a bipartite system is 
defined as the difference of the total correlation I(pab) 
and the "classical correlation" C(pj-g) 

D(p%b) = I(pab) ~ C(p^) (41) 
= S( PB ) - S(p AB ) + max V ft S(/4|nf ), 

the arrow means that the measurement {n^} is per- 
formed on B, and the information needs to be trans- 
ferred from B to A. This indicates that the quantum 
discord is not symmetric, i.e., D(p^) ^ D(p^-g), with 
D(Pjfi) = S(p A ) ~ S(p AB ) + maxnAE^SG^IIlf). 
For classical random variable, the classical correlation is 
equal to the total correlation with zero quantum discord. 

The quantum discord relies on the definition of clas- 
sical correlation [17] . For bipartite pure state pab, it 
is shown D(p AB ) = C(pab) = S(p A ) = S(p B ) = 
I{pab)/^- This is contrary to our result since it means 
there exists classical correlation in pure state. The rea- 
son is that the quantum discord and classical correlation 
are defined based on measurement. Due to measurement, 
the coherence within the state is destroyed, as the result, 
the quantum entropy transfers to the classical entropy 
(also see Appendix |A")) . According to the QFG entropy, 
S{pab) = S(p A ) = S(p B ) = I(pab), and particularly 
C(pab) = I (pab), which indicates that the quantity 
C(pab) is quantum, may not be called "classical cor- 
relation" . The next example will verify this point more 
clearly. It is shown that for the CQ state 

PAB = J2 P ^ A ^ <E> PB, (42) 

i 

with as orthonormal basis of A, the classical cor- 

relation is equal to the total mutual information, which 
is S(pb) — Si-Pi^ , (/ s)j since the best measurement on 
A to gain information about B is the projective mea- 
surement with [l7j . However, if the subsys- 
tem B is actually composed with another two subsys- 
tems, say CC — B, which forms bipartite partition with 
A as A\CC , and each state Pec' is a Bell state, la- 
beled as \tp l )('ip l \, then the state ps — ^aPab becomes 
Pb = SiKlV^X^Ii which can be the Werner state p w 
studied above. As the result, the classical correlation be- 
comes S(p w ) — ^2iPiS(\ijj 1 )) = S(p w ), which can contain 
entanglement. On the contrary, via QFG entropy, the 
correlation in the CQ state is totally the classical mixing 
entropy H(pi), since CQ state is just a separable state. 

Another physical reasoning of quantum discord relies 
on measurement effect [l8[ . It is stated the classical infor- 
mation is locally accessible, and can be obtained without 
perturbing the state of the system. Since the separa- 
ble state can be disturbed by local measurement, the 
quantum discord of separable state is not zero. For the 



separable state as defined in Eq. ([7]) in subsection III CI 
there can be local coherence in each subsystem A and B, 
the way that the local measurement disturbs the whole 
system is that it will disturb the local coherence, which 
is different with the distributed coherence, i.e., entangle- 
ment. That is, the disturbance of the whole system by 
the local measurement does not mean there exists quan- 
tum correlation. The author in Ref. [34| shows that the 
separable state is the reduced state of a classical state de- 
fined in higher dimensional space. It is reasonable that 
a reduced state of a classical state does not contain any 
quantum correlation. According to the method of QFG 
entropy, we have concluded in subsection III CI that the 
correlation in separable state is totally classical. 

Furthermore, from another point of view, the quan- 
tum discord and classical correlation are raised based on 
the observation that the conditional entropy S(pa\pb) 
requires the state of ps has been measured. However, 
this is not the case. The conditional entropy defines the 
entropy of subsystem A given we have known the exis- 
tence of B. For instance, for the separable state, our 
knowledge of the existence of the states of B can be ex- 
pressed as a set of super-operator {Cf }, which acts as 
Cf(pf) — pfSij. The state of A after the action of each 
Cf is pf . Then, the conditional entropy is S(pa\pb) — 
J2iPi s (pf)i which is equ al to S(pab) ~ S(p B ), as we 
have studied in subsection III CI 

Then, what is the physical meaning of the quantity 
C(pab) ? - Briefly, it is the difference of the entropy S(ps) 
at the initial time and the average of the entropy of the 
special state of B after each operation, as 7"1„. PiS{p\,), at 
the finial time after the measurement. In Ref. [35|, it is 
related to the "distillable common randomness" defined 
as lim„_ i . 00 C(p® B ). Further, the classical correlation is 
related to the entanglement of formation 13511 , and some 
"quantum conservation law" is formed j36|. However, 
these results depends on the coarse-grained entropy, as 
the result, will not hold anymore in the QFG entropy 
framework. 

The analysis above indicates that the concept of quan- 
tum discord is questionable, also is not compatible with 
the method of QFG entropy. However, the quantum dis- 
cord has quite wide applications. For instance, the well- 
known deterministic quantum computing with one pure 
qubit (DQC1) model (33] shows exponential speedup to 
solve the normalized trace of a unitary operator. It is ver- 
ified that the quantum discord plays the central role in 
this model [38| . Based on the method of QFG entropy, it 
is true there is no quantum correlation between the con- 
trol qubit and the target ensemble of qubits. However, 
there exists local coherence within the control qubit. It is 
not necessary to require the existence of entanglement in 
all kinds of quantum algorithms, e.g., the BB84 quantum 
key distribution (22|. That is to say, the basic distinc- 
tion of quantum computing from classical computing is 
the existence of coherence, either in local or distributed 
forms. Another remarkable application we want to men- 
tion is that the condition for complete-positive, trace- 
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preserving (CPTP) channel is proved to be zero quantum 
discord of the initial state [3{| . The role of quantum dis- 
cord in CPTP channel should be checked, and probably 
new measure of entanglement or quantumness is needed. 

Relating to quantum discord, various formulas are 
raised, reviewed in Ref. [loj], such as thermal discord, 
measurement-induced disturbance (MID), geometric dis- 
cord, etc. Strictly speaking, the quantities in the D-C 
paradigm captures the quantumness, i.e., coherence, in- 
stead of entanglement; thus, to link the D-C paradigm 
with correlation is not suitable. The non-zero quan- 
tum discord or, e.g., MID only means there exists co- 
herence (including local and distributed). Instead, we 
can quantify the quantumness of a state p directly, with- 
out relating to mutual information. For instance, we 
can still use some quantities in the D-C paradigm de- 
fined without referring to the mutual information to 
quantify quantumness, such as the geometric discord 



Dg(p) 



x|| , the relative entropy of discord 



Dji{p) = min x S(p\\x), where \ is classical state. 



B. Quantum information processing 

After the analysis of entanglement above, in this sec- 
tion we study some primary quantities in QIP, which are 
closely related with entanglement. We find that some 
quantities, relations, and statements need to be modified 
due to the method of QFG entropy. 

Channel capacity [4l|. The classical capacity C(N) of 
a classical channel Af is defined as 



C(M) = maxH(X : Y), 

Px 



(43) 



with the input X — {x,p x }, output Y — {y,q y }. Note 
that the input signals are often sent one by one as a 
sequence in time. From the property of Shannon en- 
tropy, C{Af) < H(X), and C{N® n ) = nC{N). When 
the output is the same with the input, the C(Af) reaches 
the maximal H{X), which means a perfect channel will 
transmit all the information of the input. 

For quantum channel, there exist kinds of capaci- 
ties. The Holevo classical capacity x(£) °f a quantum 
channel £ is defined based on the Holevo quantity \- 
Suppose the input is prepared as p = J^iPiPii Shan- 
non entropy of the distribution is H(pi). With the 
POVM {Ej = MjMj}, for each operator, the resulted 
state is <7j = MjpM^ /qj, qj = tr(pEj). Shannon en- 
tropy of the finial state a = J2j1j <7 j i s The 
Holevo bound states that the mutual information be- 
tween H(pi) and H(qj) is bounded as I(p with 
X = S(p) — ^2 i PiS{pi). In the standard approach, if the 
support of pi is orthogonal, then x — H(pi). Generally 
X < H(pi), then I(p :<?)<%< H(pi). However, accord- 
ing to the method of QFG entropy, it always holds that 
X = H(pi), then the Holevo bound just describes that 
Hp '■ l) ^ H(pi), which is obvious. The Holevo quantity 



X is not the quantum analogue of classical mutual infor- 
mation. For the Holevo capacity of a quantum channel, 
which is defined as 



x(£ ) = max S £ 
{piPi} \ 



PiPi 



Pi S(£( Pi )), (44) 



according to QFG entropy, x(£ ) = max{ p . p .} H(pi). We 
can define a new kind of classical capacity of quantum 
channel. Suppose the distribution {p{\ is encoded into 
a classical random variable X = {i,pi}, and the out- 
put distribution {qj} is encoded into another variable 

y = Tnen > x(£) = max { Pi , P i} H ( x ■ y), whicn 

is almost the same with C(JV). This means the classical 
capacity of a quantum channel only describes the "clas- 
sical" ability of a quantum channel, without referring to 
the ability to transmit quantum information. 

According to the QFG entropy, even the input and 
output states of a quantum channel are the same, the 
QFG entropy can be different when their decompositions 
are different. Also, even we know the decompositions 
of the input and output states, we cannot calculate the 
quantum mutual information between them if we do not 
know the global state, which is yet the case in practice. 
We can define the quantum capacity Q{£) relying on geo- 
metric distance, e.g., fidelity. For instance, the quantum 
capacity Q(£ ) of a quantum channel £ can be defined as 



Q{£) = max S FG (p) ( tvJ^/p£ {p)yfp ) 



(45) 



When the output £{p) equals to the input p, the fidelity 
is one, then the quantum capacity reaches its maximal 
Sfg(p), which means that the perfect quantum channel 
will transmit all the information, including classical and 
quantum, of the input. It is easy to see that Q(£ ) is 
additive, no regularization is needed. 

There are other quantum capacities in the literature 
[42TI45I ]. The evolution of the input p under the channel 
with output a can be viewed as one unitary operation 
on the input and one ancilla E, the coherent information 
[H |H is defined as 1{£) = m&x {p ^ Pz} (S(a) ~ S(p E )), 
whose regularization gives the quantum capacity Q(£ ). 
Recently, study showed that two zero quantum capacity 
channels can make a positive quantum capacity chan- 
nel, called "superactivation" [4y, [47|. Here we do not 
intend to analyze this problem in detail. We would like 
to point out that the notion of coherent information is not 
compatible with the quantum capacity we defined above. 
Although the coherent information is smaller than the 
entropy of input state, it can be negative, as originally 
noted [421 ]. On the contrary, quantum capacity Q(£) we 
defined is never negative and bounded by the input en- 
tropy, thus can be a measure of quantum capacity. 

Additivity of entanglement of formation etc. It is 
proved by Shor that four conjectures are equivalent: the 
additivity of minimal entropy output of a quantum chan- 
nel, the additivity of the Holevo capacity of a quantum 
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channel, the additivity of the entanglement of formation, 
and the strong superadditivity of the entanglement of 
formation, see Ref. [48[ and references therein. Here 
we study this problem from the method of QFG en- 
tropy. First, for the entanglement of formation, we have 
pointed out that in the last subsection it needs to be 
modified to Efg(pab) = mf Ifg(AB), with Ifg(AB) — 
^iPilFG^ipi))- We can easily prove that Efg is addi- 
tive. Note the Ifg for four-partite state needs to be the 
(4,2) partition. Suppose one four-partite state wabcd — 
Pab <8> &cd, then following the definition of QFG mu- 
tual information, we have Ifg{AC : BD) =Ifg{AD : 
BC) =I FG {AB) + Ifg (CD) = Ifg(ABCD). Now sup- 
pose there exist decompositions pab = J2iPiPi an d 
a CD — J2j1j a j minimize Ifg(AB) and Ifg(CD), re- 
spectively, then obviously Ifg(ABCD) is also mini- 
mized. Conversely, suppose Ifg(ABCD) is minimized 
by the set {p^, p'j} and {q'j, a'^}, then the two set must also 
minimize Ifg(AB) and Ifg(CD) respectively, due to the 
linearity of the function. As the result, Ifg(ABCD) and 
Ifg(AB) + Ifg(CD) are minimized by the same decom- 
positions, i.e., the modified entanglement of formation is 
additive. The strong superadditivity of the entanglement 
of formation follows directly due to the definition of QFG 
mutual information. The Holevo capacity of a quantum 
channel is also modified in the study above, which is ob- 
viously additive. It can be checked that the proof of the 
equivalence of the four conjectures are compatible with 
the method of QFG entropy. Recently, it was shown the 
minimal entropy output is not additive [491 ] . yet no con- 
crete example has been constructed, also it is shown later 
the minimal entropy output is locally additive [Hoj . Their 
proof should hold on their own right since the method of 
QFG entropy is not involved. Our argument above could 
be improved by more detailed study. In addition, relat- 
ing to entanglement distillation protocols, the entangle- 
ment cost is defined as the regularization of entanglement 

of formation, namely E c — lim„_>. 00 F n AB ■ Since the 
property of additivity after modification, the entangle- 
ment cost is equal to the entanglement of formation. 

C. Quantum thermodynamics 

Entropy was originally termed in classical thermody- 
namics. It seems the definition of thermodynamic en- 
tropy relies on temperature, which is a macroscopic (clas- 
sical) parameter. Since entropy is connected with statis- 
tics also quantum statistics, how about temperature? 
Recently, quantum thermodynamics researc h, e.g., quan- 
tum heat engines (5lT[54| , Maxwell's demon PVk "i!) , have 
achieved lots of progress. A quantum Carnot engine 
was proposed via a single particle trapped in ID infi- 
nite square potential well, the efficiency was shown the 
same as the Carnot efficiency [5l|. Interestingly, it was 
noted the entropy of the particle wave function needs to 
be the QFG entropy, yet without any physical argument. 
To make the similarity of quantum and classical engines 



more clearly, the analog of temperature was further in- 
troduced for the single pure quantum state [52j], and the 
formula for efficiency is exactly the same with the Carnot 
efficiency, namely, rj = 1 — To our best knowledge, 
these work can be viewed as the first applications of the 
QFG entropy in literature. Various quan tum heat en- 
gines are investigated in details in Ref. [54| , the quantum 
isothermal, isoentropic, isochoric, and isobaric processes 
are discussed, here we do not focus on this study. 

Next, we turn to present our approach to define the 
concept of quantum temperature. For the general quan- 
tum state matrix p = Y^iPil^i^il IV^) = Y^k a ki\h), 
the QFG entropy is S F g(p) = H(pi) + J2iPi S FG> with 
S FG = -Ysk^ki^ogXki, and Ajw = \otki\ 2 ■ Assume the 
Hamiltonian is W, then the energy of the state p is U — 

tr(pH) = J2iPi E i, witri E i = {ipi^Hi) = Hk e kAki- 
The variation of the energy is 

5U = ^EiSpi + ^PrfEi 

i i 

i i k i k 

= SQ + SW, (46) 

with the heat 5Q = J2t E ^Pi + J2iPiJ2k e ki^ki, the 
work SW = J^iPi Sfc ^kiSeki- Note two terms contribute 
to the change of heat, the first term is the common classi- 
cal one, denoted as 5Q C , the second term is the quantum 
one, set SQ FG = ^2 k ekiSXki- The equations (|46|) just 
express the quantum first law of thermodynamics. 
The variation of the QFG entropy is 

SSfg(p) = H(5 Pi ) + J2 S FG tPi + EP'^G, (47) 

i i 

denote the classical part as 6S C = H(5pi). The defini- 
tion of quantum temperature follows directly. The clas- 
sical temperature, which is coarse-grained, is T c = |2<l, 

the QFG temperature is T FG = g , and the quantum 
temperature can be derived as 

T - J9- 

q - SSfg 

J2 l E l 5p t + J2iPi Efc e kl SX k i 

H(6pi) + J^i S FG S Pi + J2zPt SS FG 

H(8 Pi )T c + Z i Ti. G p i 8S i FG , . 

' H{5pi) +J2 i S FG Sp i +j: i p i 6S FG [ ' 

The quantum temperature T q can be reduced to the other 
two under certain limits. If the state p is pure, it is di- 
rect to check that T q = T FG = T FGl there is no classical 
contribution for the temperature. If we employ coarse- 
graining of the state, i.e., set S FG , SS FG as zero, then 
T q = T c , there is no quantum contribution for the tem- 
perature. The study of quantum heat engine [52[ demon- 
strated that T c and T FG play the similar roles since they 
have similar formula. Our analysis of quantum tempera- 
ture indicates that temperature as well as entropy relies 
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on the feature of statistics, no matter classical or quan- 
tum. 

In addition, one point to note is that the coherence 
of the pure single quantum state does not enter into the 
formula of temperature directly, which indicates that a 
mixed state can also perform as the work substance of 
the quantum heat engine. Coherence relates to the way 
of transition between the eigenstates \ki) (via photon, 
phonon etc), for which the classical counterpart is the 
scattering among molecules in the gas; and coherence 
also relates to the geometric phase effect during the cycle, 
which is interesting for further study. 

Another focus of research centers around the second 
law of thermodynamics, for instance, to relate entangle- 
ment with the second law [60l - [64j |. For open system the 
entropy can decrease, which is not stated directly by the 
second law. As we have shown in section IIII C[ the QFG 
entropy can either increase or decrease for the quantum 
open system. The entanglement cannot increase under 
LOCC, namely, local operation and classical communi- 
cation, which shows irreversibility. Treating entangle- 
ment as distributed coherence, this irreversibility means 
that this kind of coherence cannot emerge spontaneously. 
The underlying issue is the "conservation of coherence" , 
as well as entropy and energy, which is not so clear at 
present. Also, some quantities are introduced to describe 
the quantum effects relating with thermodynamics, e.g., 
thermal discord [Hj], work deficit [(50|, however, based 
on rough observation, these quantities rely on von Neu- 
mann entropy, as the result, are not compatible with the 
method of QFG entropy. 



V. CONCLUSION 

In this work, we explored the method of quantum fine- 
grained (QFG) entropy, including its physical foundation, 
properties, and potential applications. Our results based 
on the QFG entropy arc quite different with those re- 
lated work in literature. For clarity, we make one brief 
summary. 

We classified two types of coarse-graining, type-I and 
type-II, von Neumann entropy employs the latter type. 
The QFG entropy of pure state is not zero, since the com- 
plete description of wave function is inherent statistical. 
Different decompositions of the same p contain different 
quantum information, based on our study of the formal- 
ism of state matrix. The QFG entropy satisfies the pri- 
mary properties of entropy, namely, non-negativity, addi- 
tivity, subadditivity, concavity, also strong subadditivity, 
we note that more systematic analysis might be needed. 

For the applications, we investigated the concept of en- 
tanglement, which is actually a kind of coherence instead 
of information, from the view of QFG entropy. Some 
problems can be resolved, e.g., we showed that the con- 
ditional entropy cannot be negative, the separable state 
contains only classical correlation, the concept of quan- 
tum discord is questionable. Furthermore, we verified 



that the conjecture for the additivity of the entanglement 
of formation, the minimal entropy output, the Holevo 
capacity of a quantum channel, and the strong super- 
additivity of the entanglement of formation is valid, af- 
ter some modifications due to the formula of QFG en- 
tropy. Relating to thermodynamics, we found that the 
laws of thermodynamics can be generalized to the quan- 
tum regime, particularly, the quantum temperature can 
be defined based on the QFG entropy, the irreversibility 
of entropy and entanglement can be explored also with 
the method of QFG entropy. 

The quantum fine-grained entropy has quite natural 
physical foundations, and makes the characters of quan- 
tum information much easier to understand. We expect 
that there can be more investigations and applications in 
the future. 



Appendix A: Entanglement without local mixing 

Here we show that in entangled state, the local system 
does not necessarily stay as mixed state. Consider the 
theoretical situation: two qubit atoms A and B are cou- 
pled by one photon, which can be emitted by one atom 
then absorbed by the other. There is no decoherence 
with the environment or vacuum. Then, the population 
of the ground (excited) state of A behaves the same with 
the population of the excited (ground) state of B, i.e., 
Rabi oscillation. Thus, the two atoms are in resonance 
with each other, i.e., in entangled state. Obviously, each 
of the atom is in superposed state. For simplicity, sup- 
pose the entangled state is \ip) = -^(le^gs) — ly^es)). 
Then, state A is \ip A ) = ^{\e A ) - \9a)) by ignoring B, 
state B is \ip B ) = - |es)) by ignoring A. 

The QFG entropies can be calculated as Sfg(\iP)) = 
Sfg(\iPa)) = Sfg(Hb)) = Ifg{\4>)) = I- According to 
the common approach, the state of A (B) is derived by 
tracing out system B (A), as pa = Pb = diag(l/2, 1/2). 
Then, QFG entropies can be calculated as Sfg(\iP)) — 
Sfg(pa) = Sfg(pb) = Ifg(\iP)) = 1) which is the 
same with our approach. We see that tracing turns the 
quantum entropy SfgH^a^}) into the classical entropy 
Sfg{pa,b), yet, the amount of entropy remains. Indeed, 
tracing is a kind of quantum measurement with the op- 
timal projectors, i.e., it decohers the coherence of the 
superposed state of the sub-systems leading to the mix- 
ture. If we measure the states of atoms A or B, the local 
coherence will be destroyed. Generally, we will always 
observe mixed state if we measure the sub-system, how- 
ever, this does not mean before the measurement, the 
sub-system stays as mixed state. Relating to the prob- 
lem studied here, Ref. fllj provided a physical way for 
the classification of quantum state. 
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Appendix B: Superposition paradox 

Here we raise a problem, which might be noticed widely 
yet not formed as a standard paradox. The problem is 
that the superposition of superposed state can lead to 
non-superposed eigenstate! For instance, \<fii) = (|0) + 
|1»/V2, \fo) = (|0) - |l»A/2, then (|^) + \h))/V2 = 
|0). The question is that: is there coherence within state 
|0)? Note that here |0(1)) can also stands for many-body 
state, e.g., |0(1)) = |00(11)), then we can also ask: is 
there entanglement within state |0)? 

The paradox comes from the relation between reality 
and decomposition of state matrix. If states \<px) and 



1 02) are superposed together, i.e., they exist in reality, 
they are treated as eigenstates: \<fri) = \+), |<fo) = |— ), 
which cannot be written as superposition of |0) and |1) 
again, since in this situation states |0) and |1) only po- 
tentially exist due to the property of propensity of quan- 
tum state ^l|. Then, |0) = (|+) + \-))/y/2 is super- 
posed state under basis |±). On the contrary, we also 
say |±) is superposed state under basis |0(1)). Superpo- 
sition and entanglement relate to the representation we 
choose. The physical significance of basis is consistent 
with the method of quantum fine-grained entropy, the 
superposition paradox can thus be resolved. 
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